inr network
Implicit Neural Image Field for Biological Microscopy Image Compression
Dai, Gaole, Tseng, Cheng-Ching, Wuwu, Qingpo, Zhang, Rongyu, Wang, Shaokang, Lu, Ming, Huang, Tiejun, Zhou, Yu, Tuz, Ali Ata, Gunzer, Matthias, Chen, Jianxu, Zhang, Shanghang
The rapid pace of innovation in biological microscopy imaging has led to large images, putting pressure on data storage and impeding efficient sharing, management, and visualization. This necessitates the development of efficient compression solutions. Traditional CODEC methods struggle to adapt to the diverse bioimaging data and often suffer from sub-optimal compression. In this study, we propose an adaptive compression workflow based on Implicit Neural Representation (INR). This approach permits application-specific compression objectives, capable of compressing images of any shape and arbitrary pixel-wise decompression. We demonstrated on a wide range of microscopy images from real applications that our workflow not only achieved high, controllable compression ratios (e.g., 512x) but also preserved detailed information critical for downstream analysis.
- Workflow (1.00)
- Research Report > New Finding (1.00)
- Health & Medicine > Pharmaceuticals & Biotechnology (0.93)
- Health & Medicine > Therapeutic Area > Oncology (0.68)
- Health & Medicine > Diagnostic Medicine > Imaging (0.48)
UniCompress: Enhancing Multi-Data Medical Image Compression with Knowledge Distillation
Yang, Runzhao, Chen, Yinda, Zhang, Zhihong, Liu, Xiaoyu, Li, Zongren, He, Kunlun, Xiong, Zhiwei, Suo, Jinli, Dai, Qionghai
In the field of medical image compression, Implicit Neural Representation (INR) networks have shown remarkable versatility due to their flexible compression ratios, yet they are constrained by a one-to-one fitting approach that results in lengthy encoding times. Our novel method, ``\textbf{UniCompress}'', innovatively extends the compression capabilities of INR by being the first to compress multiple medical data blocks using a single INR network. By employing wavelet transforms and quantization, we introduce a codebook containing frequency domain information as a prior input to the INR network. This enhances the representational power of INR and provides distinctive conditioning for different image blocks. Furthermore, our research introduces a new technique for the knowledge distillation of implicit representations, simplifying complex model knowledge into more manageable formats to improve compression ratios. Extensive testing on CT and electron microscopy (EM) datasets has demonstrated that UniCompress outperforms traditional INR methods and commercial compression solutions like HEVC, especially in complex and high compression scenarios. Notably, compared to existing INR techniques, UniCompress achieves a 4$\sim$5 times increase in compression speed, marking a significant advancement in the field of medical image compression. Codes will be publicly available.
- Research Report > Promising Solution (0.87)
- Research Report > New Finding (0.67)
Rotation and Translation Invariant Representation Learning with Implicit Neural Representations
Kwon, Sehyun, Choi, Joo Young, Ryu, Ernest K.
In many computer vision applications, images are acquired with arbitrary or random rotations and translations, and in such setups, it is desirable to obtain semantic representations disentangled from the image orientation. Examples of such applications include semiconductor wafer defect inspection, plankton microscope images, and inference on single-particle cryo-electron microscopy (cryo-EM) micro-graphs. In this work, we propose Invariant Representation Learning with Implicit Neural Representation (IRL-INR), which uses an implicit neural representation (INR) with a hypernetwork to obtain semantic representations disentangled from the orientation of the image. We show that IRL-INR can effectively learn disentangled semantic representations on more complex images compared to those considered in prior works and show that these semantic representations synergize well with SCAN to produce state-of-the-art unsupervised clustering results.
- Asia > South Korea > Seoul > Seoul (0.04)
- North America > United States > Hawaii > Honolulu County > Honolulu (0.04)